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WHAT IS CLAIMED IS: 



1 1. A man-machine interface method for permitting a user 

2 to act on thumbnails, each thumbnail representing an 

3 associated object containing information, for use with a 

4 machine having a video display device and a user input 

5 device, the man-machine interface method comprising: 

6 a) generating a three-dimensional environment, 

7 having a depth, to be rendered on the video display 
Q 8 device; 

§T| 9 b) determining a two-dimensional location and a 

Wi 10 depth of each of the thumbnails in the 

If! 

ffi 11 three-dimensional environment, wherein, for each of 

% 12 the thumbnails, the depth is a function of at least 

s 13 one parameter of the object associated with the 

.was. 

IX 14 thumbnail; and 

¥ l 

15 c) generating the thumbnails within the 

SI 

16 three-dimensional environment, at the determined 

^ 17 two-dimensional locations and depths, to be rendered 

18 on the video display device. 



1 2. The man-machine interface method of claim 1 wherein, 

2 for each of the thumbnails, the depth is a linear 

3 function of at least one parameter of the object 

4 associated with the thumbnail. 



1 
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3. The man-machine interface method of claim 1 wherein, 
for each of the thumbnails, the depth is a polynomial 
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3 function of at least one parameter of the object 

4 associated with the thumbnail. 

1 4. The man-machine interface method of claim 1 wherein, 

2 for each of the thumbnails, the depth is an exponential 

3 function of at least one parameter of the object 

4 associated with the thumbnail. 

1 5. The method of claim 1 wherein the at least one 

2 parameter includes at least one parameter selected from a 

3 group of parameters consisting of (a) click history, (b) 



^ 4 age, (c) time since last use, (d) size, (e) file type, 

01 5 (f) associated application, (g) classification, and (h) 

E 6 author. 

— t 

a 

Q] 1 6. The man-machine interface method of claim 1 further 

Zl 2 comprising: 

f|J 3 d) accepting inputs from the user input device; 

4 e) determining a two-dimensional cursor location 

5 based on the accepted inputs; and 

6 f) generating a cursor at the determined 

7 two-dimensional cursor location, to be rendered on 

8 the video display device. 
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7. The man-machine interface method of claim 6 further 
comprising: 
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3 g) if the two-dimensional location of the cursor is 

4 located on or over one of the thumbnails, defining a 

5 state of that thumbnail as active. 

1 8. The man-machine interface method of claim 7 further 

2 comprising: 

3 h) generating a pop-up information bar located over 

4 the active thumbnail, to be rendered on the video 

5 display device. 

0 

1^1 1 9. The man-machine interface method of claim 7 further 

J5? 2 comprising: 

3 h) if the user input provides a selection input and 

4 if an active or floated thumbnail exists, then 

5 generating a higher resolution visual representation 

6 of the object represented by and associated with the 

7 active or floated thumbnail, at a preferred viewing 
*fi 8 location at a foreground of the three dimensional 

9 environment, to be rendered on the video display 

10 device. 

1 10. The man-machine interface method of claim 7 further 

2 comprising: 

3 h) if the user input provides a float input and if 

4 an active thumbnail exists, then setting the depth 

5 of the active thumbnail to a predetermined value and 

6 defining a state of the active thumbnail as floated. 



■s=ir 
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1 11. The man-machine interface method of claim 9 wherein 

2 the act of generating the higher resolution visual 

3 representation of the object represented by and 

4 associated with the active thumbnail includes: 

5 - generating an animation which moves the 

6 higher resolution visual representation of the 

7 object represented by and associated with the 

8 active thumbnail from the location of the 

9 active thumbnail to the preferred viewing 

10 location at the foreground of the three 

11 dimensional environment, to be rendered on the 



W 12 video display device. 

m 
m 

2-1 12- The man-machine interface method of claim 11 further 

Q 

s 2 comprising: 

o 

si 3 i) if the user input provides a deselection input 

H 4 and if a selected thumbnail exists, then generating 

5 a video output for moving the high resolution visual 

6 representation of the object represented by and 

7 associated with the active thumbnail to the 

8 two-dimensional location of the selected thumbnail, 

9 to be rendered on the video display device. 

1 13. The man-machine interface method of claim 9 further 

2 comprising: 

3 i) if the user input provides a sink input and if a 

4 floated thumbnail exists, then setting the depth of 
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5 the floated thumbnail to a previous value and 

6 defining a state of the floated thumbnail as active. 

1 14. The man-machine interface method of claim 7 further 

2 comprising: 

3 h) if the user input provides a selection input and 

4 if an active thumbnail exists, then 

5 i) invoking an application related to the 

6 object represented by and associated with the 

7 active thumbnail, 

8 ii) loading the object represented by and 

9 associated with the active thumbnail into the 



10 application, and 

Zl 11 iii) generating a video output of the 

? 12 application with the loaded object represented 

01 13 by and associated with the active thumbnail at 

0 14 a preferred viewing location, to be rendered on 

r|| 15 the video display device. 

1 15. The man-machine interface method of claim 9 further 

2 comprising: 

3 h) if the user input provides a selection input and 

4 if a floated thumbnail exists, then 

5 i) invoking an application related to the 

6 object represented by and associated with the 

7 floated thumbnail, 
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8 ii) loading the object represented by and 

9 associated with the floated thumbnail into the 

10 application, and 

11 iii) generating a video output of the 

12 application with the loaded object represented 

13 by and associated with the floated thumbnail at 

14 a preferred viewing location, to be rendered on 

15 the video display device. 

0 1 16. The man-machine interface method of claim 7 further 
8*s 2 comprising: 

W 3 h) if the user input provides a move input and if 

is! 

01 4 an active or floated thumbnail exists, then 

5 i) updating the two-dimensional location of 

* 6 the active or floated thumbnail based on the 

iff* 7 move input . 



*y 1 17. The man-machine interface method of claim 16 wherein 

2 the move input is a left button mouse drag. 

1 18. The man-machine interface method of claim 1 wherein 

2 the three-dimensional environment defines a foreground 

3 and a background, and 

4 wherein the act of generating thumbnails, within the 

5 three-dimensional environment, at the determined 

6 two-dimensional locations and depths, to be rendered on 

7 the video display device, includes: 



1 
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8 i) using perspective views so that any thumbnails 

9 in the foreground defined by the three-dimensional 

10 environment appear larger than any thumbnails in the 

11 background defined by the three-dimensional surface. 

1 19. The man-machine interface method of claim 18 wherein 

2 a thumbnail partially occludes any thumbnails behind it, 

3 based on a viewing point. 

0 1 20. The man-machine interface method of claim 1 further 
|Tj 2 comprising: 

3 d) accepting inputs from the user input device; 

01 4 e) determining a viewing point two-dimensional 

i 5 location, depth and direction based on the accepted 

* 6 inputs; and 

?*\ 

jf] 7 f) generating only that portion of the 

8 three-dimensional environment and only those 

yj 

;|| 9 thumbnails that are in front of the virtual viewing 

10 point determined in act (e) , to be rendered on the 

11 video display device. 



1 21. The man-machine interface method of claim 1 wherein 

2 the thumbnails are low resolution bit maps. 

1 22. The man-machine interface method of claim 21 wherein 

2 the low resolution bit maps are 64 pixels by 64 pixels 

3 and have 24 bit color. 
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1 23. The method of claim 20 wherein if the depth of the 

2 viewing point is below a predetermined depth, further 

3 performing a step of: 

4 g) gradually decreasing the depth of the viewing 

5 point to float the viewing point while no user 

6 inputs are received. 

1 24. The method of claim 1 further comprising, for each 

2 of the thumbnails, determining a shade to be applied to 
O 3 the thumbnail based on its depth. 

W 

)** 1 25. The method of claim 24 wherein the shade to be 

Q) 2 applied to the thumbnail darkens as the depth increases. 

f*~ 

? 1 26. The method of claim 24 wherein the shade to be 

'•'en? 

2 applied to the thumbnail darkens as a distance between 

3 the depth of the thumbnail and a viewing point increases, 

1 27. The method of claim 1 further comprising, for each 

2 of the thumbnails, determining a fade to be applied to 

3 the thumbnail based on its depth. 



*pr.7 



l 

2 
3 



28. The method of claim 27 wherein the fade to be 
applied to the thumbnail increases as the depth 
increases. 
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1 29. The method of claim 27 wherein the fade to be 

2 applied to the thumbnail increases as a distance between 

3 the depth of the thumbnail and a viewing point increases, 

1 30. The method of claim 1 further comprising, for each 

2 of the thumbnails, determining a tint to be applied to 

3 the thumbnail based on its depth. 

1 31. The method of claim 30 wherein the tint to be 

p 2 applied to the thumbnail increases as the depth 

T.] 3 increases. 

w 

w 

111 

Hi 1 32. The method of claim 30 wherein the tint to be 

J 2 applied to the thumbnail increases as a distance between 

* 3 the depth of the thumbnail and a viewing point increases. 

Q 
m 



1 33. The method of claim 1 wherein the three dimensional 

2 environment includes a floor, the method further 

3 comprising a step of generating a shadow, for each of the 

4 thumbnails, on the floor. 

1 34. A system which permits a user to interact with 

2 thumbnails, each thumbnail representing an associated 

3 object containing information, the system comprising: 

4 a) an input facility for accepting user inputs; 

5 b) a storage facility containing 

6 i) a two-dimensional location, a depth and 

7 state information for each of the thumbnails, 
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8 ii) a two-dimensional cursor location, and 

9 iii) a three-dimensional environment having a 

10 simulated depth; 

11 c) a processing unit which 

12 i) accepts user inputs from the input 

13 facility, 

14 ii) updates (a) the two-dimensional location, 

15 and state information for each of the 

16 thumbnails contained in the storage facility, 

17 and (b) the two-dimensional cursor location 

18 contained in the storage facility, based on the 

19 accepted user inputs, 

20 iii) updates depth information for each of the 

21 thumbnails contained in the storage facility 

22 based on at least one parameter of the object 

23 associated with the thumbnail, and 

24 iv) generates video outputs based on 

25 A) the two-dimensional location, depth 

26 and state information for each of the 

27 thumbnails, 

28 B) the two-dimensional cursor location, 
2 9 and 

30 C) the three-dimensional environment, 

31 contained in the storage facility; and 

32 d) a video display unit for rendering the video 

33 outputs generated by the processing unit. 



• * 
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35. The system of claim 34 wherein the state information 
for each of the thumbnails contained in the storage 
facility includes an indication of whether or not the 
thumbnail is active, and 

wherein the processing unit determines that a 
thumbnail is active if a cursor is located on or over a 
thumbnail based on the two-dimensional location of the 
cursor and the two dimensional location of the thumbnail. 



3oV>. The system of claim 35 wherein the storage facility 

2 f urthe^contains descriptive textual information for each 

3 of the thurftkqiails, and 

4 wherein, rf a thumbnail is active, 

5 i) the p"&ocessing unit generates a pop-up bar, 

6 based on descriptive textual information, for 

7 the active thumbr^il, and 

8 ii) the video display unit renders the pop-up 

9 bar over the rendered t\. 

1 37. The system of claim 35 wherein, if a thumbnail is 

2 active or floated and the input facility accepts a 

3 selection input, then 

4 i) the processing unit updates the state of 

5 the thumbnail, 

6 ii) the processing unit gets a second, higher 

7 resolution, visual representation of the object 

8 represented by and associated with the 

9 thumbnail, 



• » 
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10 iii) the processing unit generates a video 

11 output based on the higher resolution, visual 

12 representation of the object represented by and 

13 associated with the thumbnail at a preferred 

14 viewing location, and 

15 iv) the video display device renders the video 

16 output generated by the processing unit. 

1 38. The system of claim 37 further comprising an audio 

P 2 output device, 

•~z 1 

■'fed? 

I^j 3 wherein the storage facility further contains a 

^ 4 first audio cue, and 

yl 5 wherein, when an object is selected, the processing 

? a 

%l 6 unit provides the first audio cue to the audio output 

M 

* 7 device. 

^ 1 39. The system of claim 37 wherein each thumbnail is a 

w 

yy 2 64 pixel by 64 pixel bit map having 24 bit color and 

* ? 3 wherein each higher resolution, visual representation of 

4 the objects is a 512 pixel by 512 pixel bit map having 24 

5 bit color. 

1 40. The system of claim 37 wherein the processing unit 

2 further effects a video output based on an animation of 

3 the higher resolution, visual representation of the 

4 object represented by and associated with the thumbnail, 

5 moving from the location of the thumbnail to a location 

6 at the foreground of the three-dimensional environment. 



# # 
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1 41. The system of claim 35 wherein if the input facility 

2 provides a float input and an active thumbnail exists, 

3 then the processing unit will set the depth of the active 

4 thumbnail to a predetermined value and will define the 

5 state of the active thumbnail as floated. 

1 42. The system of claim 35 wherein, if a thumbnail is 

2 active and the input facility accepts a selection input, 

3 then 

p 4 i) the processing unit updates the state of 

§Ti 5 the thumbnail to selected, 

^ 6 ii) the processing unit opens an application 

jfS 7 with which the object, associated with and 

% 8 represented by the selected thumbnail, is 

? 9 associated, 

0 10 iii) the processing unit loads the object into 

£ c 11 the application, 

W 

%l 12 iv) the processing unit generates a video 

^" 13 output based on the object loaded onto the 

14 opened application and a preferred viewing 

15 location, and 

16 v) the video display device renders the video 

17 output generated by the processing unit. 

1 43. The system of claim 41 wherein if the input facility 

2 provides a sink input and if a floated thumbnail exists, 

3 then the processing unit will set the depth of the 
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floated thumbnail to a previous value and will define a 
state of the floated thumbnail as active. 

44. The system of claim 37 wherein, if a thumbnail is 
active or floated and the input facility accepts a move 
input, then 

i) the processing unit updates the state and 
location of the thumbnail, 

ii) the processing unit generates a video 
output. based on the updated location of the 
thumbnail, and 

iii) the video display device renders the 
video output generated by the processing unit. 

45. The system of claim 35 wherein if a thumbnail is 
floated and the input facility accepts a selection input, 
then 

i) the processing unit updates the state of the 
thumbnail to selected, 

ii) the processing unit opens an application with 
which the object, associated with and represented by 
the selected thumbnail, is associated, 

iii) the processing unit loads the object into the 
application, 

iv) the processing unit generates a video output 
based on the object loaded onto the opened 
application and a preferred viewing location, and 
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14 v) the video display device renders the video 

15 output generated by the processing unit. 

1 46. The system of claim 34 wherein the storage facility 

2 further contains virtual viewing point location 

3 information, 

4 wherein the input facility includes a mouse, and 

5 wherein the processing unit 

6 d) accepts inputs from the user input device; 

7 e) determines a viewing point location and 

8 direction based on the accepted inputs; and 
w 9 f) generates only that portion of the 

g>5 10 three-dimensional environment and only those 

J; 11 thumbnails that are in front of the virtual viewing 

M 

w 12 point determined in step (e) , to be rendered on the 

n 

]lf% 13 video display device. 
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47. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 1. 



1 48. A machine readable medium containing data and 

2 machine executable instructions which, when executed by a 

3 machine, performs the method of claim 6. 



1 
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49. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 7. 
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50. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 8. 

51. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 9. 

52. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 10. 

53. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 11. 

54. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 12. 

55. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 13. 

56. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 14. 



fu; 
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1 57. A machine readable medium containing data and 

2 machine executable instructions which, when executed by a 

3 machine, performs the method of claim 15. 

1 58. A machine readable medium containing data and 

2 machine executable instructions which, when executed by a 

3 machine, performs the method of claim 18. 

1 59. A machine readable medium containing data and 

2 machine executable instructions which, when executed by a 

3 machine, performs the method of claim 19. 



60. A machine readable medium containing data and 
machine executable instructions which, when executed by a 
machine, performs the method of claim 20. 




